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ABSTRACT 

EOS satellite instruments operating in the visible through the shortwave infrared wavelength regions (from 0.4 pm to 2.5 pm) 
are calibrated prior to flight for radiance response using integrating spheres at a number of instrument builder facilities. The 
traceability of the radiance produced by these spheres with respect to international standards is the responsibility of the 
instrument builder, and different calibration techniques are employed by those builders. The National Aeronautics and Space 
Administration's (NASA’s) Earth Observing System (EOS) Project Science Office, realizing the importance of preflight 
calibration and cross-calibration, has sponsored a number of radiometric measurement comparisons, the main purpose of 
which is to validate the radiometric scale assigned to the integrating spheres by the instrument builders. This paper describes 
the radiometric measurement comparisons, the use of stable transfer radiometers to perform the measurements, and the 
measurement approaches and protocols used to validate integrating sphere radiances. Stable transfer radiometers from the 
National Institute of Standards and Technology, the University of Arizona Optical Sciences Center Remote Sensing Group, 
NASA’s Goddard Space Flight Center, and the National Research Laboratory of Metrology in Japan, have participated in 
these comparisons. The approaches used in the comparisons include the measurement of multiple integrating sphere lamp 
levels, repeat measurements of select lamp levels, the use of the stable radiometers as external sphere monitors, and the rapid 
reporting of measurement results. Results from several comparisons are presented. The absolute radiometric calibration 
standard uncertainties required by the EOS satellite instruments are typically in the ±3% to ±5% range. Preliminary results 
reported during eleven radiometric measurement comparisons held between February 1995 and May 1998 have shown the 
radiance of integrating spheres agreed to within ±2.5% from the average at blue wavelengths and to within ±1.7% from the 
average at red and near infrared wavelengths. This level of agreement lends confidence in the use of the transfer radiometers 
in validating the radiance scales assigned by EOS instrument calibration facilities to their integrating sphere sources. 
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1. INTRODUCTION 


The international Earth remote sensing scientific community has unanimously recognized the need for long term precise and 
accurate remote sensing data to assess natural and anthropogenic effects on Earth’s climate and environment. In an effort to 
provide those data, NASA’s EOS was implemented. It is an 18 year, international, multi-satellite, multi-instrument program 
in global remote sensing of the Earth. The goal of the EOS mission is to advance the scientific understanding of the Earth 
system and its changes on a global scale through a deeper understanding of the components of that system and their many 
interactions. The precisions and accuracies of the EOS instruments’ measurements are directly derived from the science 
requirements of the remote sensing community, the ultimate users and interpreters of EOS data. These precision and 
accuracy requirements are state-of-the art for measurements made by on-orbit satellite instruments and, in some cases, even 
for measurements made by instruments in the more hospitable environment of the laboratory. 

In order to achieve required EOS instrument precision and accuracy requirements and thereby correctly interpret long term 
EOS data, on-orbit changes in the satellite instruments must be differentiated from actual changes in the remotely sensed 
Earth scenes. The ability to differentiate these processes initially depends on careful prelaunch calibration of the satellite 
instruments with respect to physical standards and thorough prelaunch characterization of the instruments at the system and 
subsystem levels. Following launch, the ability to differentiate these processes depends on the ability of instrument on-board 
calibration systems to monitor changes to the prelaunch calibration and on comparisons of satellite instrument measurements 
with measurements made by calibrated ground-based, airborne, and other satellite borne instruments. The multi-instrument 
nature of the EOS program underscores the need to relate satellite, ground-based, and airborne instrument measurements 
through a common set of physical standards and processes. It is only through this process that biases between instrument 
data can be eliminated and data from a number of instruments can be used with confidence by Earth remote sensing scien- 
tists. 

The pre-launch calibrations of EOS satellite, ground-based, and airborne instruments operating in the visible through short- 
wave infr ared wavelength regions (i.e. 0.4 pm to 2.5 pm) are placed on a common scale through the use of available physical 
standard sources and artifacts provided by national standards laboratories. The validation of the calibration of these EOS 
instruments is accomplished using ultra-stable transfer radiometers designed, built, and independently calibrated by national 
standards laboratories and secondary standards calibration facilities. Transfer radiometers from the National Institute of 
Standards and Technology (NIST), the National Research Laboratory of Metrology-National Space Development Agency of 
Japan-Japan Resources Observation System Organization (NRLM-NASDA-JAROS), the University of Arizona (UA) Optical 
Sciences Center Remote Sensing Group, and NASA’s Goddard Space Flight Center (GSFC) have participated in eleven 
radiometric measurement comparisons at a number of EOS instrument calibration facilities in the United States and Japan. 
This paper describes the transfer radiometers, outlines the comparison goals, and presents preliminary measurement results. 

2. THE TRANSFER RADIOMETERS 

The transfer radiometers that have participated in the radiometric measurement comparisons are briefly described below. The 
wavelengths and bandwidths of the filter transfer radiometers are provided in Table 1. 

2.1 NIST TRANSFER RADIOMETERS 

NIST has participated in EOS radiometric comparisons with the NISTVisible/near infrared Transfer Radiometer (VXR), the 
Sea-viewing Wide Field-of-view Sensor (SeaWiFS) Transfer Radiometer (SXR), and the NIST Shortwave Infrared Transfer 
Radiometer (SWIXR). The NIST VXR and SXR are filter radiometers of similar optical design 1 . The VXR and SWIXR 
were built by NIST for the EOS Project Science Office, while the SXR was built for the SeaWiFS Project Office. Beginning 
in May 1998, the NIST Shortwave Infrared Transfer Radiometer (SWIXR) participated in radiometric measurement 
comparisons 2 . The SWIXR is a double monochromator-based scanning spectroradiometer incorporating all-reflective input 
optics and a liquid nitrogen cooled indium antimonide (InSb) detector. The operating wavelength range of the SWIXR is 0.8 
jim to 2.5 \in\. 



2.2 U A TRANSFER RADIOMETERS 


The UA Visible/Near Infrared radiometer (UA VNIR) 3 and the UA Shortwave Infrared transfer radiometer (UA SWIR) have 
participated in EOS radiometric measurement comparisons. The UA VNIR is a filter radiometer with seven channels corre- 
sponding to spectral bands in the Moderate Resolution Imaging Spcctroradiometer (MODIS), the Advanced Spacebome 
Thermal Emission and Reflection Radiometer (ASTER), and the Multi-angle Imaging SpectroRadiometer (MISR) EOS 
instruments. The UA SWIR is a nine channel filter radiometer employing a liquid nitrogen cooled InSb detector. The SWIR 
channels are chosen to correspond with 4 MODIS and 5 ASTER bands. 
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Note: The NIST, UA VNIR, and NASA’s GSFC wavelengths and bandwidths are the result of moment analyses. The UA 
SWIR center wavelengths are the result of a moment analysis, and the bandwidths are the result of a full-width-at half- 
maximum analysis. The NRLM-NASDA-JAROS wavelengths are center values calculated from the 50% response 
points and the bandwidths are lull-width at half-maximum values. 

Table 1. Wavelengths and Bandwidths of the Filter Transfer Radiometers 



2.3 NASA’s GSFC LANDSAT TRANSFER RADIOMETER 


The NASA’s GSFC Landsat Transfer Radiometer (LXR)^ participated in a number of EOS radiometric measurement com- 
parisons. The LXR is a filter radiometer of similar optical design to the SXR and VXR; it was built by Reyer Corporation* 
for the Landsat Enhanced Thematic Mapper Plus (ETM 4 ) Science Office. 


2.4 NRLM-NASDA-JAROS TRANSFER RADIOMETERS 

The NRLM-NASDA transfer radiometers include six, single fixed wavelength filter radiometers operating in the visible 
through near infrared region 5 . The NRLM-JAROS transfer radiometers include three, single fixed wavelength filter radi- 
ometers operating in the visible through near infrared region and two, single fixed wavelength filter radiometers operating the 
shortwave infrared region 6 . The center wavelengths and bandwidths of the NRLM-NASDA and NRLM-JAROS radiometer 
filters were selected to closely match bands in the Ocean Color and Temperature Scanner (OCTS) and ASTER satellite 
instruments, respectively. 

2.5 NASA’s GSFC 746/INTEGRATING SPHERE IRRADIANCE COLLECTOR 

The NASA’s GSFC 746/Integrating Sphere Irradiance Collector (ISIC) is a scanning single-grating monochromator-based 
spectro-radiometer equipped with a 10.2 cm diameter collection sphere at the monochromator entrance port 7 . Using silicon 
photodiode and lead sulfide detectors, the 746/ISIC transfers the irradiance calibration from a NIST calibrated irradiance 
standard lamp to the integrating sphere being measured. A knowledge of the aperture areas of the sphere under test and the 
ISIC collection sphere coupled with a knowledge of the distance between the two apertures, enables the radiance of the 
sphere under test to be calculated. In the visible/near infrared wavelength region from 400 nm to 1000 nm, the 746/ISIC 
obtains data in 10 nm steps with a bandwidth of 10 nm. In the shortwave infrared wavelength region from 1000 nm to 
1600 run, data is obtained every 20 nm with a bandwidth of 20 nm. In the wavelength region from 1600 nm to 2400 nm, data 
is obtained every 20 nm with a bandwidth of 40 nm. 

3. THE RADIOMETRIC MEASUREMENT COMPARISONS 

Planning for a radiometric measurement comparison begins with the determination of exact dates for the comparison to be 
held at the host institution. The host institution for the comparison is the facility where the satellite, ground-based, or air- 
borne instrument is calibrated using the calibration source to be measured. The exact dates for the comparison are deter- 
mined through the consensus agreement of the host institution and the institutions which plan to participate with their transfer 
radiometers. Following the determination of the comparison dates and participants, the EOS Calibration Scientist, as a mem- 
ber of the EOS Project Science Office, drafts a measurement plan and circulates the plan among the participating institutions. 
The measurement plan is designed to address a number of issues concerning the calibration and operation of the integrating 
sphere to be measured. These issues include the following: 

1. Validation of the calibration of the integrating sphere over a range of output radiances similar to those 
realized while using the sphere to calibrate satellite, ground-based, or airborne instruments; 

2. Measurement of the stability of the radiance from the integrating sphere using transfer radiometers as sphere 
output monitors; 

3. Measurement of the repeatability of the radiance from the integrating sphere through repeated measurements 
of selected sphere levels; 

4. Examination of the overall operation, measurement procedures, and documentation of the operation of the 
integrating sphere by the host institution. 

Item 1, the validation of the radiometric scale assigned to the integrating sphere by the host institution against the radiance 
scale maintained by national standards laboratories, is the primary goal of the radiometric measurement comparison. The 
Ability to realize this primary goal is dependent on the measurement of items 2 and 3, the sphere stability and repeatability. 


* Certain commercial equipment, instruments, or materials arc identified in this technical memorandum to foster 
understanding. Such indentification does not imply recommendation or endorsement by NIST, nor does it imply that the 
materials or equipment identified are necessarily the best available for the purpose. 



respectively. A secondary goal of the radiometric measurement comparison is to make simultaneous, direct comparisons of 
measurements made by the host institution, national standards laboratories, and other participating institutions involved in the 
calibration of ground-based and airborne remote sensing instrumentation. A tertiary goal is given in item 4, that is, to evalu- 
ate the host institutions measurement procedures and results in terms of basic metrology and good measurement practice. In 
order to achieve these goals, the host institution must either participate in the measurement comparison or provide recently 
measured radiance data on their integrating sphere to the measurement participants. 

Upon agreement by the host and participating institutions on the measurement plan, the participants arrive at the host institu- 
tion on the day designated in the plan, unpack, setup, and warmup their equipment. The equipment remains powered, night 
and day, for the duration of the comparison. Following equipment warmup, the host and participating institutions hold a 
meeting to discuss and make final refinements to the measurement plan and to distribute comparison log sheets. Actual 
measurements on the integrating sphere under test begin the following morning. The participants first synchronize their data 
acquisition system clocks to a common time. During the measurements, each participating institution records the time of 
their measurement, ancillary measurement information, and the data filenames on the log sheets. The host institution is 
responsible for operating the integrating sphere under test, recording the sphere lamp currents/voltages, and recording and 
archiving sphere monitor detector readings. At the end of each measurement day, a meeting is scheduled at which each par- 
ticipating institution reports its measured radiances. This “rapid results” meeting gives a quick and very preliminary indica- 
tion of the overall agreement or disagreement of the data. Significant discrepancies between results presented at this meeting 
can be used to indicate areas which should be examined in advance of the next day’s measurements. At the end of the com- 
parison, each participant provides the EOS Calibration Scientist an electronic copy of their data files. The host institution 
provides a copy of their record of sphere lamp currents and voltages and data obtained from sphere monitor detectors. 



Figure 1. Percent difference of 412 nm radiance measurements made by the NIST VXR, the University of Arizona VNIR, 
and the GSFC 746/ISIC radiometers from the average. These measurements were performed at GSFC in November 
1997. 


From February 1995 to the present, eleven EOS radiometric measurement comparisons have been held. The dates, locations, 
host institution, participating institutions and transfer radiometers, and integrating sphere or spheres measured are presented 
in Table 2. 


4. PRELIMINARY RADIOMETRIC MEASUREMENT COMPARISON RESULTS 

The measurement results presented in this paper, restricted to the visible/near infrared, are those reported by the radiometric 
comparison participants at the end of each comparison day. As such, these results are viewed by the comparison participants 
to be preliminary. These data are produced by each participating group using their own calculational techniques. An 
improvement in the agreement of these data is achieved through the implementation of common algorithms in the analysis of 
the measurement results. A program to standardize the methods of reporting, analyzing, comparing, and archiving these data 




is underway between the NASA's GSFC EOS Program Science Office and NIST. Still these preliminary data do provide 
good examples of the level of agreement of measurements made by the independently calibrated transfer radiometers. 
Moreover, these data show that the transfer radiometers are capable of validating the radiance scales of integrating spheres to 
better than the radiometric accuracy specifications of the instruments which employ these spheres as uniform radiance 
calibration sources. 

Figures 1 through 4 show the typical agreement between transfer radiometer measurements at 412 nm, 441 nm, and 662 nm 
reported during several measurement comparisons. Figure 1 shows agreement at 412 nm with the average of the transfer 
radiometer measurements to better than ±2% for the integrating sphere levels indicated. Figure 2 presents similar data at 
441 nm and shows agreement with the average to better than ±2.5%. Figures 3 and 4 show agreement at 662 nm with the 
average to better than ±1.7%. These levels of agreement betw een the transfer radiometer measurements is remarkable con- 
sidering that each radiometer is calibrated independently, using standards traceable to NIST in most cases, in each 
participating institution’s metrology laboratory and the only time that transfer radiometer measurements are compared is at 
the radiometric measurement comparisons. 

The level of agreement among the transfer radiometers is commensurate with the estimated relative standard combined 
uncertainties for the determination of spectral radiance of an unknown source. For the VXR and the SXR, the uncertainty is 
about 1.5% 8,9 ; for the UA VNIR, the uncertainty is about 2.2% 9 . NRLM assigns a value of 1% 9 . The 746/ISIC uncertainties 
are about 5% at 411 nm, 2.5% at 441 nm, and 1.5% to 1000 nm 9 . 

Figure 5 presents normalized radiance repeatability measurements obtained using the NIST VXR while viewing integrating 
spheres at Raytheon SBRS and JPL in August 1996. At each measurement comparison, at least one operating sphere level 
was designated as a level to be measured at the beginning and close of each measurement day. Interestingly, the data of Fig- 
ure 5 shows the largest changes in sphere output radiance at 487 nm and 548 nm. 

Figure 6 illustrates the radiance stability measurements from an internal sphere monitor detector and the NIST VXR while 
viewing the integrating sphere located at the University of Arizona Optical Sciences Center. The internal monitor detector in 
the UA integrating sphere is a silicon photodiode equipped with a photopic filter. In these measurements, the VXR 
monitored the integrating sphere at its six wavelengths off-axis while other instruments viewed the sphere on-axis. Only two 
VXR channels are illustrated; similar results were obtained at the other wavelengths. In Figure 6, the decrease in the sphere 
output dectected by the UA monitor photodiode is confirmed by the SXR data and is on the order of 0.5% over 4 hours. The 
NIST VXR, SXR, and the University of Arizona SW1R radiometers have functioned successfully in a number of 
measurement comparisons as sphere stability monitors. This capability is particularly important when measuring integrating 
spheres that are not equipped with filtered monitor photodiode detectors. 

The NIST SWIXR, the UA SWIR, the NRLM/JAROS shortwave infrared radiometers, and the GSFC 746/TSIC spectro-radi- 
ometer have participated in fewer radiometric measurement comparisons than their visible/near infrared counterparts. Pre- 
liminary results from the most recent comparison held at NASA’s Ames Research Center in August and September 1999 
indicate agreement between the NIST SWIXR, the UA SWIR, and the GSFC 746/ISIC at ±2% at 1646 nm and ±2.5% at 
2263 nm. It must be emphasized that these results are preliminary, and additional comparisons in the shortwave infrared are 
needed to fully quantify the level of agreement of these measurements 
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Figure 2. Percent difference of 441nm radiance measurements made by the NIST SXR and VXR, the University of Arizona 
VNIR, the GSFC LXR, and the GSFC 746/ISIC radiometers from the average. These measurements were performed at 
the Jet Propulsion Laboratory in August 1996, at GSFC in November 1997, and at Raytheon Santa Barbara Remote 
Sensing in May 1998. The sphere level is indicated in each plot by the number and power of the lamps used and, in the 
case of the JPL sphere, the percentage of the opening between the principal and auxiliary sphere. 
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Figure 3. Percent difference of 662 nm radiance measurements made by the NIST SXR and VXR, the NRLM/JAROS 
ASTER, the University of Arizona VNIR, and the GSFC 746/ISIC radiometers from the average. These measurements 
were performed at NEC/Yokohama, Japan in February 1995 and 19%, at the Jet Propulsion Laboratory in August 19%. 
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Figure 4. Percent difference of 662 nm radiance measurements made by the NIST VXR, the University of Arizona VNIR, 
the GSFC LXR, and the GSFC 746/ISIC radiometers from the average. These measurements were performed at GSFC in 
November 1997 and at Raytheon Santa Barbara Remote Sensing in May 1998. 





Figure 5* Sphere repeatability measurements using the NIST SXR. These measurements were performed at Raytheon Santa 
Barbara Remote Sensing and at Jet Propulsion Laboratory in August 1996. For the Raytheon SBRS measurements, the 
integrating sphere was operated with ten 8W, nine 45W, and four 200W lamps illuminated. For the JPL measurements, 
the integrating sphere was operated at Level 1 with four 30W, thirteen 200W illuminated and with the auxiliary sphere 
aperture 20% open. The integrating sphere was operated at Level 2 with three 30W, six 200W illuminated and with the 
auxiliary sphere aperture 100% open. 
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Figure 6. Stability of the UA lm BaS0 4 integrating sphere. The top plot shows the percent decrease of the signal measured 
by the sphere’s silicon photodiode monitor detector equipped with a photopic filter. The lower two plots show the 
percent decrease of the NIST VXR signal at 411.8 nm and 548.0 nm when the VXR is used as an off-axis sphere 
monitor. The time is reported in hr:min:sec Mountain Standard Time (MST). 



